According to Jeff Dean on X, Google unveiled TPU v8t for large-scale training and TPU v8i for high-throughput inference at Cloud Next, with detailed specifications in Google’s official blog post. According to Google Cloud’s announcement, v8t focuses on massive model training efficiency with next-gen interconnects and larger HBM capacity, while v8i targets low-latency, cost-efficient inference at scale for production LLMs. As reported by Google, the new TPUs integrate tightly with Vertex AI and JAX/PyTorch integrations, enabling faster time-to-train and lower total cost of ownership for enterprise generative AI workloads. According to Google’s blog, early benchmarks highlight improved performance per dollar and energy efficiency versus prior TPU generations, positioning v8t for frontier model training and v8i for high-QPS serving. For businesses, according to Google Cloud, this split architecture creates clear deployment paths: consolidate training on v8t pods for large foundation models and shift latency-sensitive inference to v8i to optimize throughput and cost.